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Method and system for embedding machine readable digital data in grayscale images^ 



I The piesent invention provides a system and 
method for unobtrusively embedding machine 
readable digital data of many different types in 
grayscale images for a wide variety of difTierent 
purposes. To accomplish that, digital data is 
written into such an image t>y means of a low 
contrast modulation of the grayscale density of 
background porttons and/or certain foreground 
features of the images, suitably at a spatial 
frequency and a modulation contrast that cause 
the resulting grayscale modulatk>n of the image 
to fall bek>w the perceptual threshokl of the 
ordinary observer who views the image from 
normal viewing (fistance. The foreground feat- 
ures that are amenable to having digital data 
encoded in them are those that nominally have 
a substantially uniform grayscale density over 
an appreciat)le area, such as alphanumeric 
characters and halftone dot pattems, as well as 
unifbnmly shaded lines and blocks. 
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This invention relates generally to psychophysi- 
cally improved techniques for embedding machine 
readat>le digital data in grayscale images and, more 
particularty, to a method and system for unobtrusively 
encoding machine readable data in hardcopy prints of 
such images. 

Grayscale printing processes have been 
developed for producing hardcopy renderings of 
scanned-in and computer generated synthetic 
images. For example, the Fuji Xerox SCATT printer 
employs a thennal sublimation process for printing 
grayscale digital images containing up to 256 levels of 
gray at a resolution of 254 spots/inch (s.p.l.). 

Polychromatic imaging (sometinDes simply refer- 
red to as "color imaging") is becoming increasingly 
important and comnnonplace for digital image proces- 
sing applications. It, therefore, is to be understood 
that the present Invention can be utilized for embed- 
ding d^ital data in printed renderings of polychroma- 
tic grayscale images, typically by employing multiple 
iterations of the same data encoding process for iden- 
tically encoding the data in each of the color sepa- 
rations that are provided to produce such renderings. 
However, in the interest of simplifying this disclosure 
the following discussion wfll concentrate on the mono- 
chromatic case. 

Others have recognized that the functional utility 
of plain paper and other types of hardcopy documents 
can t>e enhanced significantly if the human readable 
infomnation that they nomnally convey is supplemen- 
ted by adding appropriate machine readable digital 
data to them. This digital data can be recovered by 
existing input scanners, so the data can be employed 
for various purposes during the electronic processing 
of such documents and their human readable con- 
tents by electronic docimient processing systems, 
such as electronic copiers, text and graphic image 
processing systems, facsimile systems, electronic 
mail systems, electronic file systems, and document 
and character recognition equipn^nt 

As is known, machine readable digital data can 
be recorded by writing two dimensional marks on a 
recording medium in accordance with a pattem which 
encodes the data either by the presence or absence 
of marics at a sequence of spatial locatk>ns or by the 
presence or absence of mark related transitk>ns at 
such locations. The bar-like codes which others have 
proposed for recording digital data on paper utilize 
tiiat type of encoding. See US Patent No. 4,692,603 
on "Optical Reader for Printed Bit-Encoded Data and 
Method of Reading Same." US Patent No. 4,728,783 
and US Patent No. 4,754.127 on "Method and 
Apparatus for Transforming Digitally Encoded Data 
into Printed Data Strips," and US Patent No. 
4,782,221 on "Printed Data Strip Including Bit-Enco- 
ded Infomiatbn and Scanner Contrast" Another 
interesting approach is to encode machine readable 
dig ital data in the shapes of the marics or "glyphs" that 



are written on the recording medium. 

Some of the recent work in this field has focused 
on the printed appearance of the codes that are 
employed for embedding digital data in hardcopy 

5 documents. For example, it has been shown that 
glyph shape codes can be designed to have a more 
or less uniform grayscale appearance. However, 
there still Is a need for even less obtmsh^e codes for 
encoding digital data on hardcopy documents. 

10 An object of the present invention is to provide a 
mettKxJ and system for unobtrusively embedding 
machine readable digital data in grayscale images. 

Accordingly, the present inventton provides a 
system for emt>edding binary data in a grayscale 

15 miage that is defined a set of grayscale image sanv 
ples that have various grayscale values, character- 
ised in that said system includes a grayscale 
modulator for nr)odulating selected ones of said Image 
samples in accordance with said binary data to 

20 superimpose a low contrast binary rr>odulation on saki 
selected image samples, said selected image sam- 
ples having constant nonninal grayscale values that 
are nrK>dulated in accordance with said binary data; 
and a grayscale printer coupled to said nrK)dulator for 

25 printing a hardcopy rendering of said image in res- 
ponse to said image samples, thereby embedding 
said binary data in saM hardcopy. 

The present invention also provkies a method for 
embedding binary data in a hardcopy rendering of a 

30 grayscale image that is defined by a set of image sanrv- 
pies of varying grayscale value, characterised in that 
sakI method indudes selecting image samples for at 
least one spatially contiguous portion of said image 
that are of constant nominal grayscale value; mod- 

35 ulafa'ng the grayscale values of said selected image 
samples in accordance with said binary data to cause 
saki selected Image samples to swing back and forth 
between near neighboring grayscale values at a pre- 
determined frequency as a functbn of said binary 

40 data; and printing sakI hardcopy rendering of sakl 
image in response to said image samples, induding 
said selected samples. 

In various emt)odiments the digital data is written 
into such an image by nr^eans of a low contrast modu- 

45 lation of the grayscale density of background portions 
and/or certain foreground features of the inriages, suit- 
ably at a spatial frequency and a modulation contrast 
that cause the resulting grayscale modulation of the 
Image to fall below the perceptual threshold of the 

50 ordinary observer who views the image fix>m normal 
viewing distance under normal illumination cond'h 
tions. The foreground features that are amenable to 
having digital data encoded in them in accordance 
with this invention are those that nominally have a 

55 substantially uniform grayscale density over an 
appreciable area, such as alphanumeric characters 
and halftone dot patterns, as well as unifonnly shaded 
lines and blocks. 
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The invention will be described further, by way of 
example, with reference to the accompanying draw- 
ings, in which:- 

Fig. 1 is a simplified block diagram of a grayscale 

inriaging system that embodies the present inven- 5 

tion; 

Fig. 2 is an enlarged grayscale image that has 
digital data encoded in its foreground and back- 
ground in accordance with an abnonnally high 
contrast implementation of this Invention; io 
Fig. 3 is an enlarged grayscale image of an 
alphanumeric character that has its ASCII calling 
code embedded in it, again at an abnormally high 
contrast to provide a visible presentation of the 
grayscale modulation; and is 
Fig. 4 is a curve illustrating the perceptual 
threshold and the sensitivity of a normal human 
adult observer, who views an image at normal 
viewing distance under normal illumination condi- 
tions, to contrast variations occurring at different 20 
spatial frequencies. 

While the invention is described in some detail 
hereint>elow with specific reference to an illustrated 
embodiment, it is to be understood that there is no 
intent to limit it to that emt)odiment On the contrary, 25 
the aim is to cover all alternatives, modifications, and 
equivalents fialling within the scope of the invention as 
defined by the appended claims. 

Turning now to the drawings, and at this point 
especially to Fig. 1 , there is a grayscale imaging sy&- 30 
tem 21 comprising a grayscale iTKxiulator 22 Ibr 
superimposing a low contrast binary modulation on 
certain of the grayscale image samples that are pro- 
vided at a predetermined sample rate (by means not 
shown) to cause a more or less conventional grays- 35 
cale printer 23 to produce a hardcopy print of a scan- 
ned-in or a computer generated synthetic grayscale 
image. As will be appreciated, the modulation of the 
image samples for preselected foreground and/or 
background portions of the inmge in accordance with 40 
binary data causes the printer 23 to correspondingly 
modulate the grayscale of the selected portions of the 
printed image, thereby embedding the binary data in 
the printed image. In keeping witti this invention, how- 
ever, the contrast and spatial frequency of this modu- 45 
lation are selected to prevent the nrKxJutatk>n from 
materially detracting from the perceived quality of tiie 
printed image (i. e., the modulation that is perfbnmed 
by the modulator 22 causes the grayscale sample 
values that are applied to the printer 23 to swing back 50 
and forth between near neighboring gray scale levels 
asafunctbnofthebinarydate). Indeed, as described 
in some additional detail hereinbelow, the contrast 
and spatial frequency of the binary modulatk>n of the 
image preferably are selected to cause the nfK>du- 55 
lation to fall below the perceptusd threstidd of an ordi- 
nary observer who views the printed image at normal 
viewing distence. 



As illustrated, the binary data that to be embed- 
ded in the printed innage is loaded (by means not 
shown) into a buffer 25 that is toggled into and out of 
operation by a control signal for serially applying the 
binary data to the nfiodulator 22 at a predetermined 
dock frequency in timed synchronism with the image 
samples tor the portions of the image in which it is des- 
ired to embed the binary data. The nnodulator 22 oper- 
ates in a standby mode to pass unaltered grayscale 
image samples to the printer 23 whenever the control 
signal is at a false ("0") logic level. But when ttie con- 
trol signal is at a true f 1") logic level, an AND gate 26 
gates clock pulses to the buffer 25 at a predetermined 
frequency, thereby causing the txjffer 25 to serially 
apply the binary data to the modulator 22 at the dock 
frequency. The dock frequency for the buffer 25 is 
selected to be an integer multiple of the rate at which 
image samples are applied to the printer 23 to permit 
reliable recovery of the binary data. As a general rule, 
the spatial resolution of the printer 23 also is taken into 
account while selecting the dock frequency for the 
buffer 25 to cause the binary date to be embedded in 
the printed image at a desired spatial frequency. 

Various techniques may be employed for 
synchronizing the modulator 22 with the printer 23. 
For example, if a page description language (PDL) 
decomposer (not shown) is emptoyed for generating 
the grayscale image samples for the printer 23 from 
a PDL encoding of the document that is to t>e printed, 
the PDL decomposition of the document may be 
analyzed (by means not shown) to klentify the image 
samples that correspond to preselected, uniformly 
toned foreground features or background areas of the 
document. Altematively, the grayscale image sam- 
ples may analyzed (by means not shown) to kientify 
sequences of "White" (t>ackground) or "t>lack" 
(uniformly toned foreground at the upper end of the 
, grayscale range) samples in excess of a predeter- 
mined run lengtii. 

Likewise, the digitel date that is embedded in the 
printed image nnay teke several forms. For instence, 
the embedded date could encode a PDL description 
of the document, preferably using a spatially distri- 
buted, redundant encoding so that a "dean copy" of 
document could be reconstructed from a printed copy 
that has been marlced-up, steined, or even partially 
destroyed. Or, alternative incarnations of a document, 
such as foreign language translations of it, may be 
digitelly embedded in a printed copy of the document 
Similariy, digitized sound or speech could be digitelly 
recorded in a printed document Furthemnore, this 
invention may be employed to digitally embed hyper- 
text or hypermedia pointers in hardcopy printe of 
grayscale documents. Moreover, digital signatures, 
copy authorization codes, editing histories, and even 
encrypted messages could all be digitally emtmdded 
in such grayscale prints. 

Fig. 2 illustrates a relatively simple grayscale 
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image that has digital data embedded in its foreg- 
round and t)ackgn>und in accordance with an emtx>- 
diment of the invention. The contrast of the digital 
modulation of this image has been exaggerated for 
illustrative purposes, but it will be seen that this embo- 5 
diment may be utilized for emt>edding digital data in 
any nominally uniformly gray foreground or back- 
ground area of a grayscale print that significantly 
exceeds the spatial resolution of the printer 23 (Fig. 
1). Fig. 3 shows, again in exaggerated contrast form, io 
the use of an emt>odiment of the present invention for 
encoding the ASCII calling code for an alphanumeric 
character In the printed representation of the charac- 
ter (In this instance, the code is oriented vertically with 
respect to the character). As will be appreciated, 15 
embedded ASCII calling codes may be used in lieu of, 
or as an error correction mechanism for, standard 
character recognition techniques for transforming 
printed alphanumeric text back into the etectronic 
domain. 20 

Turning now to Fig. 4, the contrast sensitivity 
function described by Robert Sekular et al., A Con- 
temporary Approach to Form Perception, Alfred F. 
Knopf, Inc., N. Y., N. Y, 1 985, p. 1 55 leads to the con- 
clusk>n that grayscale variations of less than atxHJt 25 
1 .2% that occur at a spatial frequency of at least about 
127 cydes/inch (or, in terms of printer resolution, 
about 254 s. p. i.) fall bekm the perceptual threshold 
of an ordinary observer who views a grayscale image 
at a nonmal viewing distance of 14 inches. This 30 
suggests that binary data can be sub-perceptually 
encoded in a grayscale image that is printed by a 256 
gray level printer by restricting the modulation con- 
trast to three or fewer grayscale levels. However, 
crosstalk between dosely adjacent pixels and/or 35 
other printer anamolies may require the use of a lower 
spatial frequency for writing the digital data into the 
printed image. Thus, it is notable tfiat such a printer 
may sub-perceptually emt>ed digital data in a printed 
image at a spatial frequency as low as about 63 40 
cydes/inch (126 a p. i.) if the modulation contrast is 
limited to be less than about 0.045% (i. e., about one 
level out of 256). 

In view of the foregoing, it now will be understood 
that tfie present invention provides a method and sys- 45 
tern for unobtrusively embedding digital data of vari- 
ola descriptions in grayscale hardcopy prints of 
scanned-in and computer generated synthetic 
images, thereby enhancing the functionality of such 
prints. It also will be appredated. that the spatial fire- so 
quency and the modulation contrast at which the digi- 
tal data is embedded in such images are selected to 
prevent the embedded data from materially degrading 
the perceived quality of the printed image. Indeed, it 
will be evident that state of the art grayscale printers 55 
have suffident grayscale resolution forsut>-perceptu- 
ally encoding digital data into the images they print 



Claims 

1. A system (21) for embedding binary data in a 
grayscale image that is defined a set of grayscale 
image samples that have various grayscale 
values, characterised in that said system (21) 
indudes a grayscale nrKxJulator (22) for modulat- 
ing selected ones of said image samples in 
accordance with said binary data to superimpose 
a low contrast binary modulation on said selected 
image samples, said seleded nmage samples 
having constant nominal grayscale values tttat 
are modulated In accordance with said binary 
data; and a grayscale printer (23) coupled to said 
nrKKjulator (22) for printing a hardcopy rendering 
of said image in response to said image samples, 
thereby embedding said binary data in said 
hardcopy. 

2. A system (21) as daimed in Claim 1, character- 
ised in that at least some of said selected image 
samples define bad^round characteristk:s of 
said image. 

3. A system (21) as daimed in daim 1, cliaracter- 
ised in that at least some of said selected image 
samples define a foreground feature of said 
image. 

4. A system (21) as daimed In Claim 3, cliaracter- 
ised in that other of saki seleded image samples 
define t>ackground characteristics of said Image. 

5. A system (21) as daimed in any one of Claims 1 
to 4, characterised in that the modulation of said 
selected Image samples is reproduced by said 
printer (23) at a contrast and spatial frequency 
that cause sakI modulation to be imperceptible to 
a normal observer who views said hardcopy rer>- 
dering at normal viewing distance under normal 
illumination. 

6. A method for embedding binary data in a 
hardcopy rendering of a grayscale image that is 
defined by a set of image samples of varying 
grayscale value, characterised In that said 
method indudes selecting inriage samples for at 
least one spatially contiguous portion of sakJ 
image that are of constant nominal grayscale 
value; modulating the grayscale values of said 
selected vnage samples in accordance witti said 
binary data to cause said selected Image sanv- 
ples to swing back and forth between near 
neighboring grayscale values at a predetermined 
frequency as a function of said binary data; and 
printing said hardcopy rendering of said image in 
response to said image samples, induding said 
selected samples. 
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7. A method as claimed in Claim 6, characterised In 
that at least some of said selected image samples 
define background characteristics of said image. 

8. A method as daimed in Qaim 7, characterised in 5 
that at least some of said selected image samples 
define a foreground feature of said image. 

9. A method as claimed in Claim 8, characterised in 

that other of said selected image samples define io 
background characteristics of said image. 

1 0. A method as claimed in any one of aainns 8 to 9, 
characterised in that the modulation of said selec- 
ted image samples is reproduced by said printer 15 
(23) at a contrast and spatial frequency that 
cause said modulatk>n to be imperceptible to a 
nonmal observer who views saM hardcopy ren- 
dering at nomial viewing distance under normal 
illumination. 20 
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